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COLLISION WARNING SYSTEM 
RELATED APPLICATIONS 

The present application claims the benefit xmder 35 USC 119(e) of US provisional 
application 60/560,049 filed on April 8, 2004, the disclosixre of which is incorporated herein by 
reference. 

FIELD OF THE INVENTION 

The invention relates to methods and apparatus for estimating a time to collision 
between a vehicle and an obstacle. 

BACKGROUND OF THE INVENTION 

Automotive accidents are a major cause of loss of life and dissipation of resources in 
substantially all societies in which automotive transportation is common. It is estimated that 
over 10,000,000 people are injxjred in traffic accidents annually worldwide and that of this 
number, about 3,000,000 people are severely injured and about 400,000 are killed. A report 
"The Economic Cost of Motor Vehicle Crashes 1994" by Lawrence J. Blincoe published by the 
United States National Highway Traffic Safety Administration estimates that motor vehicle 
crashes in the U.S. in 1994 caused about 5.2 million nonfatal injuries, 40,000 fatal injuries and 
generated a total economic cost of about $150 billion. 

Lack of driver attention and tailgating is estimated to be a cause of about 90% of driver 
related accidents. Methods and apparatus that would alert a driver to a potential crash and 
provide him or her with sufficient time to undertake accident avoidance action would 
substantially moderate automotive accident rates. For example a 1992 study by Daimler- Benz 
indicates that if passenger car drivers have a 0.5 second additional warning time of an 
impending rear end collision about 60 percent of such collisions can be prevented. An extra 
second of warning time would lead to a reduction of about 90 percent of rear-end collisions. 

Various systems collision warning/avoidance systems (CWAS) exist for recognizing an 
impending collision and warning a driver of the danger. US 5,529,138, describes a CWAS that 
uses a laser radar to determine distance and relative velocity to determine a time to collision of 
a vehicle with an object. US 5,646,612 describes a CWAS system comprising a laser radar and 
an infrared (IR) camera. A processor determines a time to collision (TTC) of a vehicle with an 
object responsive to signals provided by the laser radar and whether the object is a human, an 
animal or an inanimate object responsive to image data provided by the IR camera. The system 
operates to warn a driver of an impending collision with an object based on the TTC and kind 
of object "and properly performs deceleration and braking operations based on a position of the 
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object and a speed of the vehicle is disclosed". The disclosures of the above noted U.S. Patents 
are incorporated herein by reference. 

Laser radar systems are relatively complicated systems that are generally expensive and 
tend to suffer from narrow field of view and relatively poor lateral resolution. PCT Publication 
5 WO 01/39018, the disclosure of which is incorporated herein by reference, describes a CWAS 
that comprises a camera and a processor for processing image data provided by the camera The 
camera provides images of an environment in which a vehicle is located and the processor 
determines a TTC of the vehicle with an obstacle by processing, optionally only, image data 
provided by the camera. The processor determines the TTC responsive to scale changes in the 
10 size of the obstacle as imaged in the images under the assumption that the relative velocity 
between the vehicle and the object is constant. 

SUMMARY OF THE INVENTION 
An aspect of some embodiments of the invention relates to providing an improved 
method and apparatus for determiaing at a given time t, a time to collision, TTC(t), of a vehicle 
15 with an object using a plurality of camera images of an environment in which the vehicle is 
located. 

An aspect of some embodiments of the invention relates to determining TTC(t) of the 
vehicle with the object by processing image data provided by the images without assuming that 
relative velocity between the vehicle and the object is substantially constant. In accordance 
20 with an embodiment of the invention, image data provided by the plurality of images is 
processed to provide an estimate of TTC(t), heremafter Ta(t), which is responsive to the 
relative acceleration between the vehicle and the object. Optionally, only the image data is used 
to determine TTC(t). 

In accordance with an embodiment of the invention, to detennine T^Ct), the image data 
25 is processed to determine for the given time t, a ratio, hereinafter referred to as relative scale 
"S(t)", between dimensions of a feature of the object in different images of the plurality of the 
images. S(t) is used to determine an instantaneous relative velocity estimate for determining 
TTC(t), hereinafter Tv(t), at the given time. Tv(t) is equal to a distance between the vehicle and 
the object at time t divided by their instantaneous relative velocity. Tv(t) is estimated from S(t), 
30 optionally using methods and algorithms described in PCT Publication WO 01/39018 cited 
above. According to an aspect of some embodiments of the invention, relative acceleration is 
expressed as a ftinction of a time derivative T'y(t) of Ty(t) at a given time and Ta(t) is 
determined as a fimction of the relative acceleration or a fimction of TV(t)- 
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An aspect of some embodiments of the invention relates to determining whether a 
vehicle is on a colUsion covirse with an object responsive, to image data in a plurality of images 
of the vehicle enviromnent that image the object. Optionally, only the image data is used to 
determine whether the objects are on a collision course. 

hi accordance with an embodiment of the invention, the rniages are processed to 
determine trajectories for at least two features of the object toward which the vehicle is moving 
that substantially determine a width of the object parallel to the width of the vehicle. The 
vehicle and the object are determined to be on a collision course if, as the vehicle and object 
approach each other, for example as indicated by a value determined for TTC(t), the trajectories 
of the at least two features bracket at least a portion of the vehicle. In general, the object is 
another vehicle on the roadway on which the vehicle is moving and the at least two features, 
which may for example be edges, taillights or headlights of the other vehicle, are optionally 
features that determine a magnitude for the width of the other vehicle. 

There is therefore provided in accordance with an embodiment of the present invention, 
a method of estimatmg a time to collision (TTC) of a vehicle with an object comprising: 
acqmring a pluraUty of images of the object; and determming a TTC from the images that is 
responsive to a relative velocity and relative acceleration between the vehicle and the object 
Optionally the method comprises determining the relative velocity or a function thereof from 
the images and using the relative velocity or function thereof to determine TTC. 

Optionally, determining the relative velocity or function thereof, comprises determining 
a change in scale of an image of at least a portion of the object between images of the 
pluralities of images and using the change in scale to determine the relative velocity or function 
thereof Additionally or alternatively the method comprises determining the relative 
acceleration or a function thereof from the images and using the relative acceleration or 
function thereof to determine TTC. Optionally, determining the relative acceleration or 
function thereof comprises determining a time derivative of the relative velocity or the function 

of the relative velocity. 

In some embodiments of the invention, TTC is determined only from information 

derived from the unages. 

In some embodiments of the invention, the method comprises determining whether the 
vehicle and the object are on a course that leads to a collision at the TTC. Optionally, 
determining whether the vehicle and object are on a collision course comprises: determining 
motion of at least two features of the object relative to the vehicle from tiie unages; and 
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determimng from the relative motions whether at TTC the first and second features straddle at 

least a part of the vehicle. 

There is further provided in accordance with an embodiment of the invention, ^paratus 
for determining a time to collision (TTC) of a vehicle with an object comprising: at least one 
5 camera mounted in the vehicle and adapted for acquiring images of objects in the environment 
of the vehicle; and a processor that receives image data from the camera and processes the data 
to determine a TTC in accordance with a method of the invention. 

Optionally, the at least one camera comprises a single camera. Additionally or 
alternatively the apparatus comprises alarm apparatus for alerting a driver of the vehicle to a 
10 possible colUsion with the object responsive to the TTC. In some embodunents of the 
invention, the apparatus comprises alarm apparatus for alerting persons outside of the vehicle 
to a possible collision of the vehicle with the object responsive to the TTC. In some 
embodiments of the invention, the at least one camera rniages an envkonment in front of the 
vehicle. In some embodiments of the invention, the at least one camera images an environment 
15 in back of the vehicle. In some embodiments of the invention, the at least one camera images 
an environment to a side of the vehicle. 

There is therefore provided in accordance with an embodiment of the invention, a 
method of determining whether a first object and a second object are on a collision course 
comprisijig: acquiring an image of the second object from a position of the first object at each 
20 of a plurality of known times; determining motion of at least two features of the first object 
relative to the second object from the images; determimng an estimate of a possible time to 
collision (TTC) of the first and second objects; and determining from the relative motions 
whether at the TTC, the first and second features straddle at least a part of the vehicle and if so 
that the objects are on a colUsion covirse. 
25 Optionally, determining motion of the at least two features comprises determining 

lateral motion of tiie features relative to the first object. Optionally, determining whether the 
features straddle tiie first object at the TTC comprises extrapolating lateral locations of tiie 
features at TTC from then: motion at times at which tiie images are acquked. Optionally, 
determining TTC comprises determining TTC from tiie unages. In some embodiments of tiie 
30 invention TTC is determined only from the images. 

There is fijrther provided in accordance witii an embodiment of the invention, a method 
of determining relative acceleration between a first and second object comprising: acquiring a 
plurality of images of tiie second object from locations of tiie first object; determining a change 
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in scale of an image of at least a portion of the second object between images of the pluralities 
of images; using the change in scale to determine acceleration of a function of the acceleration. 
Optionally, the acceleration or function thereof is determined only from data in the images. 

BRIEF DESCRIPTION OF FIGURES 

5 Non-limiting examples of embodiments of the present invention are described below 

with reference to figures attached hereto, which are listed following this paragraph. In the 
figures, identical structures, elements or parts that appear in more tlian one figure are generally 
labeled with a same numeral in all the figures in which they appear. Dimensions of components 
and features shown ia the figures are chosen for convenience and clarity of presentation and are 

1 0 not necessarily shown to scale. 

Fig. 1 schematically shows a fnst "following" vehicle having a colUsion 
warning/avoidance system (CWAS), operating to provide a warning of collision with a second 
"lead" vehicle in ftont of the following vehicle, m accordance with an embodiment of the 
present invention; 

1 5 Fig. 2 shows a graph that provides a comparison between TTC(t) for the vehicles shown 

in Fig. 1 determined equal to Tv(t) in accordance with prior art and TTC(t) determined equal to 
Ta(t), in accordance with an embodiment of liie present invention; 

Fig. 3 shows a graph that compares the results of alerting the driver of the following 
vehicle to a possible collision with tiie lead vehicle in accordance with prior art and alerting tiie 
20 driver to a possible collision in accordance with the present invention; and 

Fig. 4 schematically illustrates determining whether a vehicle is on a collision course 
with another vehicle, in accordance with an embodunent of the present mvention. 

DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION 
Fig. 1 schematically shows a first, lead vehicle 21 traveling along a road 20 followed by 
25 a second, following vehicle 22 having a CWAS 30 in accordance with an embodiment of the 
present invention. CWAS 30 comprises a camera 32 that images, by way of example, the 
environment in fi'ont of following vehicle 22 and a processor 34 that processes image data 
provided by the camera to repeatedly update an estimate of a time to collision (TTC) of a 
possible rear end colUsion of following vehicle 22 with lead vehicle 21. CWAS 30 comprises 
30 at least one device (not shown), for alerting a driver of following vehicle 22 to a possible 
collision with an object in front of the vehicle responsive to estimates of TTC provided by 
processor 34. 
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At any given time t lead and following vehicles 21 and 22 are separated by a distance 
Z(t), hereinafter also referred to as "range", have a relative velocity V(t), which is changing 
with a relative acceleration a(t) (which may of course be zero). Ih accordance with an 
embodiment of the invention, at time t processor 34 determines an estimate of time to collision 
TTC(t) to be equal to Ta(t), which is an estimate responsive to relative acceleration a(t), 
between lead vehicle 21 and following vehicle 22 at the given time. 

In accordance with an embodiment of the invention, processor 34 processes image data 
from a plurality of images to provide an estimate of relative scale S(t). Processor 34 determines 
S(t) from a ratio of dimensions of a feature of lead vehicle 21 in at least two different images of 
the lead vehicle acquired by camera 32 at times close to the given time. For example, assume 
that at first and second times tj and t2, which define a time interval At that optionally includes 
the given time t, camera 32 acquires fnst and second images respectively of lead vehicle 21. 
Let a distance between two features of lead vehicle 21, or a dimension of a feature of the lead 
vehicle, such as for example width of the lead vehicle, have a length (as measured for example 
in pixels or millimeters) in the first and second images represented by w(ti) and w(t2) 
respectively. Then, optionally, 

S(t) = w(t2)/w(ti). (1) 

If at times ti and t2 the lead and following vehicles 21 and 22 are separated by 
distances, Le, "ranges", Z(ti) and Z(t2) respectively, then assuming perspective projection of a 
scene imaged by camera 32 on a photosensitive surface of the camera 

S(t) = Z(ti)/Z(t2). (2) 

If the vehicles have an average relative velocity (assxmied negative if distance between 
tiae vehicles is decreasing and positive if distance is increasing) V(t) during the time interval At, 
then assuming that At is relatively small, Z(ti) = [Z(t2) - V(t)At] and S(t) may be written 

S(t) = [Z(t2) - V(t)At]/Z(t2), (3) 

from which it can be shown after relatively straightforward manipulation, 

Z(t2)A/^(t) = -At/(S(t)-l). (4) 

Assuming that relative acceleration between lead and following vehicles 21 and 22 is 
zero (or that time to collision TTC(t) is independent of relative acceleration) TTC(t) for 
vehicles 21 and 22 may be estimated as equal to TY(t), where 

Tv(t) = -Z(t)A^(t) = -Z(t2)mt) = At/(S(t)-l), (5) 
(it is recalled that V(t) is defined negative if the vehicles are getting closer to each other). 
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The foregoing derivation of TTC(t) = Tv(t), which assumes relative acceleration equal 
to zero and results in TTC(t) being dependent only on the instantaneous velocity, is based on 
the analysis presented in WO 01/39018 cited above. 

Abandoning the assumption of zero acceleration, in accordance with an embodunent of 
the present invention, TTC(t) is estimated as equal to Ta(t), which has a value optionally 
determined responsive to an equation of the form, 

Z(t+Ta(t)) = 0 = Z(t)+V(t)Ta(t)+0.5a(t)Ta(t)2. (6) 
Eqxiation 6 assumes that from time t until collision, relative acceleration between lead and 
following vehicles 21 and 22 is constant and equal to a(t) and that following time t by a time 
lapse equal to Ta(t), range is equal to zero, i.e. the vehicles have contacted. 

Solving equation 6 for Ta(t) provides an expression: 
Ta(t) = (- V(t) + [V(t)2 - 2Z(t)a(t)] 1/2 )/a(t). (7) 

To evaluate Ta(t) the inventors have noted that a time derivative T'v(t) of TyCt) may be 
written (note equation 5 above), 

TV(t) = d(-Z(t)A^(t))/dt = -Z'(t)A^(t) + Z(t) a(t)A^(t)2 = (a(t)Z(t)A^(t)2) .i (8) 
It is convenient to define a parameter C(t), where 

C(t) = TV(t)+l = a(t)Z(t)mt)2, (9) 
from which, 

a(t) = C(t)V(t)2/Z(t). (1^> 

Substituting the expression for a(t) from equation 10 into tiie expression for Ta(t) from 
equation 7, manipulating the results and using tiie expression Tv(t) from equation 5 provides a 
"compact" expression for Ta(t), namely 

Ta(t) = [Tv(t)/C(t)][l-(H-2C(t)] 1/2. (1 1) 

In the above expressions, T^t) is optionally approximated by -Z(t2)/V(t) = At/(S(t)-l) 
(equation 5 above). T'v(t) is optionally determined by determining a time derivative responsive 
to values of Tv(t) determined in accordance witii equation 5 for a plurality of different times t. 
For example, optionally, a plurality of values of T^t) determined for a plurality of different 
times t, optionally before a given time t, are used to determine, usmg any of various metiiods 
known in the art, an analytic curve for Tv(t) as a fimction of time. The time derivative of tiie 
analytic curve evaluated for the given time t provides T'v(t) for tiie given time. 

To provide a numerical example that compares determming TTC(t) = Ta(t), in 
accordance witii an embodiment of the present mvention, with determining TTC(t) in 
accordance witii prior art in which TTC(t) = Tv(t), assume tiiat two vehicles are traveling at a 
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same velocity equal to 70 kmph. Assume that the vehicles are separated by a range equal to 50 
m and that at a time t = 0 the "lead" driver of lead vehicle 21 spots an obstacle on road 20 and 
"hits" the brakes to decelerate at a maximum, constant, deceleration equal to 7.5 m/s^ to stop 
the lead vehicle. Assume that at the time that the lead driver hits his or her brakes, the driver of 
following vehicle 22 has shifted his or her attention from the road in front of him or her and is 
looking at a road sign at the side of the road. As a result, the "following" driver does not notice 
the brake lights of lead vehicle 21 tuming on at t = 0 when the lead driver hits the brakes or 
does not pay sufficient attention to the brake lights of the lead vehicle turning on. The driver of 
foUowmg vehicle 22 must rely on CWAS 30 to provide a wammg of a possible rear end 
collision with lead vehicle 21 with sufficient lead-time to prevent the collision. Fmally, assume 
that when alerted, the "followuig" driver ^pUes the brakes to decelerate following vehicle 22, 
also at a constant deceleration of 7.5 m/s2 and that from a time at which the following driver is 
alerted to a danger there is a lag reaction time of about 1.6 seconds until the driver effectively 
applies the brakes of the following vehicle. (Driver reaction times are noted on page 27 of 
"Vehicle and hifrastructure-Based Technology for the Prevention of Rear-End CoUisions"; 
Special Investigation Report, No. PB2001-917003, published by tiie National Transportation 
Safety Board, Washington D.C. May 1, 2001. On page 27 tiie report notes tiiat "typical driver 
perception-reaction time ranges from 0.9 to 2.1 seconds witii tiie 95-tii percentile reaction time 
of 1.6 seconds") 

Fig. 2 shows a graph 40 that provides a comparison between TTC(t) determined equal 
to Tv(t) and TTC(t) determined equal to Ta(t) in accordance witii an embodhnent of the present 
invention, subject to the assumptions described in tiie preceding paragraph. Curves 41 and 42 
give values of Ta(t) and TyCt) noted along the left hand ordinate of graph 40 as fimctions of 
time noted along tiie abscissa of tiie graph from the time t = 0 at which lead driver of lead 
vehicle 21 applies tiie brakes. By way of example, it is assumed that CWAS 30 activates an 
alarm to alert a driver of foUowing vehicle 22 to a possible colUsion if its evaluated TTC(t) is 
equal to or less tiian a collision alarm time (CAT) of about 2.8 seconds. CAT equal to 2.8 
seconds is indicated in graph 40 by a line 44. From curve 41 and CAT line 44 it is seen tiiat 
CWAS 30 alerts the driver of following vehicle 22 to a possible rear end coUision witii lead 
vehicle 21, in accordance Avitii an embodiment of tiie invention, about 0.85 seconds after tiie 
driver of the lead vehicle has applied the brakes. 

Because of the 1.6 seconds lag in reaction time, the following driver manages to apply 
tiie brakes only at a time 2.45 seconds after tiie lead driver applies tiie brakes to lead vehicle 21. 
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An arrow 46 indicates the elapsed time between the time at which the alert is given in 
accordance with an embodiment of the uivention and a time at which the following driver 
applies the brakes. The discontmuity m Ta(t) occurs at a time at which the following driver 
applies the brakes and for a short period of time while lead vehicle 21 is still decelerating and 

5 the lead veliicle has not come to a full stop, the relative acceleration is zero. Similarly, from 
curve 42 it is seen that were CWAS 30 to alert the driver in accordance with prior art, i.e. 
TTC(t) = Tv(t), the following driver would be alerted to a possible collision at a time about 
1.85 seconds after the driver of lead vehicle 21 applied the brakes. The alert provided by prior 
art is given almost a full second later than the alert provided by an embodiment of Hie invention 

10 and the following driver would only apply the brakes at a time of about 3.45 seconds after the 
lead driver applies the brakes. An arrow 48 mdicates the elapsed time between the time at 
which the alert is given in accordance with prior art and a time at which the following driver 
applies the brakes. 

The import of the added warning time afforded the driver by an embodiment of the 

1 5 present invention is that the driver of following vehicle 22 avoids a coUision with lead vehicle 
21 that the driver would not avoid given an alert based on TTC(t) = TyCt). 

Fig. 3 shows a graph 50 that compares the results of alerting the driver in accordance 
with an embodiment of the present invention, i.e. TTC(t) = Ta(t), for CAT = 2.8 seconds with 
results of alerting the driver in accordance with prior art i.e. TTC(t) = Tv(t) for the same CAT. 

20 Curve 51, also labeled Za(t) in an upper portion 54 of graph 50 gives range between lead 
vehicle 21 and following vehicle 22 as a ftmction of time after the driver m lead vehicle 21 
applies the brakes for the case in which the driver of foUowmg vehicle 22 applies the brakes 
after being alerted by CWAS 30, in accordance with an embodiment of the invention. Curve 
61, also labeled Va(t), in a bottom part 64 of graph 50, corresponds to cvirve 51 and gives the 

25 relative velocity between lead and following vehicle 21 and 22 for the case where the driver of 
following vehicle 22 appUes the brakes responsive to an alert in accordance with the invention. 
Curve 52, also labeled ZyCt), in upper portion 54 of graph 50 gives range between lead vehicle 
21 and foUowmg vehicle 22 were the driver in following vehicle 22 to apply the brakes 
responsive to an alert in accordance with the prior art. Curve 62 ui bottom part 64 corresponds 

30 to curve 52 and gives the relative velocity Vv(t) between the lead and following vehicles were 
the driver of following vehicle 22 to apply the brakes responsive to an alert based on the prior 
art. 
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Cvirve 51 shows that range Za(t) between lead and following vehicles never reaches 
zero, but instead both vehicles come to a full stop with a range between the vehicles equal to 
about 0.4 m at a time equal to about 5.2 seconds after the lead driver applies the brakes. Curve 
61 shows that relative velocity Va(t), which is equal to zero before the driver of lead vehicle 21 
applies the brakes (both lead and following vehicles 21 and 22 are traveling at a same velocity), 
decreases rapidly during a period in which lead vehicle 21 is decelerating after being braked 
until a time at which the driver of following vehicle 22 manages to apply the brakes. 
Thereafter, for a short time, until lead vehicle 21 comes to a full stop, relative velocity is 
constant while both vehicles lead and following vehicles 21 and 22 decelerate at a same 
acceleration (7.5 m/s^) and relative acceleration is zero. After lead vehicle 21 comes to a stop 
at a time mdicated by an arrow witness line 69 also labeled with the word "STOP", the relative 
velocity increases rapidly to zero as deceleration of following vehicle 22 provides a positive 
relative acceleration. 

Curves 52 and 62 indicate a substantially different scenario than curves 51 and 61. 
Curve 51 shows that range Zy(t) crosses zero and following vehicle 22 "meets" lead vehicle 21 
at a time equal to about 4 seconds indicated by an arrow witness line 71, also labeled 
"CRASH". Curve 62 shows that at the time that the vehicles meet, the magnitude of relative 
acceleration Vv(t) is quite large, mdicatmg that following vehicle 22 does not contact lead 
vehicle 21 gently, but crashes into lead vehicle with substantial force. It is noted that whereas in 
the above described scenario, sufficient warning is provided by CWAS 30 to prevent a crash, a 
warning in accordance with an embodiment of the invention, if not sufficient to prevent a crash, 
will in general provide relatively more time to mitigate severity of a crash. 

Whereas a method in accordance with an embodiment the invention for determimng 
TTC(t) in accordance with Ta(t) can provide an improved determination of TTC(t), it does not 
by itself determine whether, if no action is taken by a driver, a collision will actually occur. For 
example, a lead vehicle may be located in a driving lane adjacent to that in which a following 
vehicle is located. A CWAS in the following vehicle, usmg only a method similar to that 
described above, may determine that the following vehicle will rear-end the lead vehicle at a 
particular TTC, when in fact the following vehicle is not on a collision course with the lead 
vehicle but will just pass the lead vehicle at the particular TTC. 

hi accordance with an embodiment of the invention, a CWAS mstalled in a vehicle 
processes images provided by its camera not only to determine a TTC for the vehicle with an 
object, but also to determine whether the object and the vehicle are on a collision course. In 
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accordance with an embodiment of the invention, the CWAS's processor determines 
trajectories for at least two features of an object with which tiie vehicle is closing that 
substantially determine a width of the object parallel to tiie width of the vehicle. The CWAS 
determines that the vehicle and the object are on a collision course if, as the vehicle and object 
approach each other, for example as indicated by TTC(t) = Ta(t), the trajectories of the at least 
two features bracket at least a portion of the vehicle comprising the CWAS. Usually, the object 
is another vehicle on the roadway on which the vehicle comprising the CWAS is moving and 
the at least two features, which may for example be edges, taillights or headUghts of the other 
vehicle, are optionally features that determine a magnitude of the width of the other vehicle. 

Fig. 4 is a schematic birds-eye view of lead and following vehicles 21 and 22 on road 
20 shown in Fig. 1 and illustrates a situation in which a CWAS, e.g. CWAS 30, in accordance 
with an embodiment of the invention operates to determine if the two vehicles are on a 
collision course. 

It is assumed, by way of example, that road 20 is a two lane highway that curves to the 
left and that lead vehicle 21 is in a right hand lane 61 and following vehicle 22 is in a left hand 
passing lane 62. Lanes 61 and 62 are separated by lane markings 63. Following vehicle 22 is 
accelerating, or has accelerated, to a passing velocity in order to pass lead vehicle 22 and is 
schematically shown in dashed Imes at three different locations on highway 20 relative to lead 
vehicle 21 as the following vehicle passes the lead vehicle. Optionally, CWAS 34 is operating 
to update TTC(t) for following and passing vehicles 21 and 22 in accordance with an 
embodiment of the invention and determines TTC(t) = Ta(t). 

In accordance with an embodiment of tiie invention, processor 34 processes unages 
provided by camera 32 to identify and locate at least two features that determine a width of lead 
vehicle 21 in each of a plurality of the unages. Any of many various pattern recognition 
algorithms known in the art may be used to identify the features. For example, an edge 
detection algorithm may be used to identify edges 64A and 66B of lead vehicle 22 or taillights 
66A and 66B that are separated by a distance substantially equal to the width of the vehicle. By 
way of example, it is assumed that processor 34 identifies and locates taillights 66A and 66B of 
lead vehicle 22 in each of a plurality of images as following vehicle 22 passes lead vehicle 2 1 . 

In Fig. 4 lead vehicle 21 is schematically shown in an image 70 acqmred by camera 32 
at each of the positions of following vehicle 22 shown in the figure. For each position of 
vehicle 21, image 70 acquired at the position is shown immediately to the left of the vehicle. 
Features in unages 70 are optionally located relative to an image x-y coordinate system having 

11 



wo 2005/098782 PCT/IL2005/000063 

a centea- 72 located at a point in the images corresponding to the optic axis of camera 32. As 
following vehicle 22 draws near to lead vehicle 21, "taillight images" 66A' and 66B' of 
taillights 66A and 66B respectively move progressively to the right of center 72 along the x- 
axis. In accordance with an embodiment of the invention, processor 34 processes images 70 to 
determine whether motion of taillight images 66A' and 66B' along the x-axis of unages 
acquired by camera 32 indicate whether vehicles 21 and 22 are on a collision course. 

Let the x-coordinates taillight images 66A' and 66B' in each of the unages acquired by 
camera 32 be represented by Xa(t) and xb(t) and let corresponding real space x-coordinates of 
taillights 66A and 66B relative to the location of camera 32 in vehicle 21 be respectively XA(t) 
and XB(t). For convenience of presentation the real space x-coordinate, Xq, of camera 32 is 
defined equal to zero (i.e. the camera is at the origm of coordinates). At some initial time, to, at 
which a first image 70 of lead vehicle 21 is acquired by camera 32, the x-coordinates of 
tailUght images 66A' and 66B' are Xa(to) and xb(to) and let the range at time to of the lead 
vehicle relative to following vehicle 22 be Z(to). Using perspective projection it can be shown 
that the range Z(t) of lead vehicle 21 at a time t later than to be expressed, 

Z(t) = [xa(t) - xb(t)] Z(to)/[Xa(to) - xb(to)]- ^^^^ 
Using equation 12, the real space x-coordinates of taillights 66A and 66B may be written, 

XA(t) = (Xa(t)Z(to)/f)([xa(to) - Xb(to)]Z(toy[Xa(t) - Xb(t)]) (13) 
XB(t) = (xb(t)Z(to)/f)([xa(to) - xb(to)]Z(to)/[xa(t) - xb(t)]), (14) 
where f is the focal length of camera 32. 

In accordance with an embodiment of the invention, processor 34 processes image data 
provided by camera 32 to determine values for Xa(ti) and xb(ti) and therefrom XA(ti) and 
XB(ti) responsive to equations 13 and 14 at a plurality of times ti equal to and greater than to- 
At a given tune t, the processor extrapolates the determined values for XA(ti) and XsCti) to 
provide values for XA(TTC(t)) and XB(TTC(t)). Optionally, TTC(t) = Ta(t). In accordance 
with an embodiment of the invention, if XA(TTC(t)) and XB(TTC(t)) straddle the coordinate 
Xc of camera 32 (i.e. have opposite signs assuming Xc = 0) then processor 32 determines that 
lead and following vehicles 21 and 22 are on a collision course. 

It is noted that since a sufficient condition for XA(TTC(t)) and XB(TTC(t)) to straddle 
Xc is that they have opposite signs, processor 32 can use an arbitrary value for Z(to) when 
determining if they stiaddle Xq- However, if both XA(TTC(t)) and XB(TTC(t)) lie to the left 
or the right of Xq, processor 32 cannot determine for sure, responsive only to equations 13 and 
14 if lead and followmg vehicles 21 and 22 are, or are not, on a collision course witiiout a 

12 
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realistic value for ZCto)- ^ ^-"^^^ of values for Xa(ti) and xb(ti), Z(to) determines 
magnitudes of displacement of XA(TTC(t)) and XB(TTC(t)) from Xc- In particular, if both 
XA(TTC(t)) and XB(TTC(t)) are displaced to a same, one side of Xq, Z(to) determines if they 
are displaced sufficiently so that vehicles do not collide. In some embodiments of the 
5 invention, processor 34 processes images 70 using methods described in "Vision Based ACC 
with a single Camera: Bounds on Range and Range Rate Accuracy"; G.P. Stein, O. Mano and 
A. Shashua; Proceedings of IEEE Intelligent Vehicles Symposium (IV2003), pages 120-125, 
Jun. 9-11, 2003, Colxraibus, OH. USA; the disclosure of which is incorporated herein by 
reference, to determine a value for Z(to). For relatively short ranges up to about 20 to 30 meters 

10 motion parallax may optionally be used to determine a value for Z(to). 

Whereas in the above description of exemplary embodiments of the invention a CWAS 
was installed in the front end of a vehicle to alert the vehicle's driver to a possible collision 
with an object in front of the vehicle, a CWAS in accordance with an embodiment of the 
invention may of co\rrse be installed elsewhere in a vehicle. For example, a CWAS may be 

15 installed in the rear of a vehicle to alert the driver to a possible rear end collision or in the sides 
of the vehicle to alert the driver to possible side collisions. A CWAS installed in such locations 
of a vehicle may provide a driver with sufficient time to enable him to take action that might 
mitigate severity of a rear end or side collision. 

A CWAS m accordance with an embodiment of the invention may operate any of 

20 various alarms, for example audio, visual or tactile alarms, to alert a driver to a possible 
collision. However, it is noted liiat a possible collision between a vehicle comprising a CWAS 
and another vehicle, will in general have potential to affect more than the driver and occupants 
of the vehicle outfitted with the CWAS. The possible collision does of course have substantial 
potential to affect the driver and occupants of the other vehicle and persons in the immediate 

25 environment of the vehicles. Furthermore, were the driver of the other vehicle and persons in 
the immediate environment made aware of the possible collision in which they may be 
participants, they might be able to take action that contributes to avoiding the collision or 
mitigating its effects. 

Therefore, in accordance witibi some embodiments of the invention, a CWAS is 
30 configured to alert persons other than the driver of the vehicle in which it is installed to a 
potential collision. When a possible collision is anticipated by the CWAS it optionally operates 
an alarm or alarms that alert drivers of other vehicles and pedestrians in the environment of the 
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vehicle to the possible collision. For example, the CWAS may control the vehicle's hom to 
generate a particijlar type of audio alarm or the vehicles lights to flash warning signals. 

It is noted that whereas in the exemplary embodiments, a CWAS is described as 
processing images provided by its camera to determine whether to alert a driver to a potential 

5 collision, a CWAS in accordance with an embodiment of llie invention may process data 
additional to image data to determine risk of a potential collision. For example, the CWAS may 
use data provided by a vehicle's speedometer, or sensors that generate signals responsive to 
operation of the vehicle's brakes or gas pedal to determine risk of a collision. 

In addition, a CWAS in accordance with some embodiments of the invention may 

10 perform functions other than to warn a driver and optionally other persons of an impending 
colUsion. For example, if the CWAS determines responsive to a TTC that risk of a collision is 
greater than a predetermined risk level and that driver is not undertaking any collision 
avoidance action, the CWAS may be equipped to apply the brakes. 

In the description and claims of the present application, each of the verbs, "comprise" 

15 "include" and "have", and conjugates thereof, are used to indicate that the object or objects of 
the verb are not necessarily a complete listing of members, components, elements or parts of 
die subject or subjects of the verb. 

The present invention has been described using detailed descriptions of embodiments 
thereof that are provided by way of example and are not intended to limit the scope of the 

20 mvention. The described embodiments comprise different features, not all of which are 
required in all embodiments of the invention. Some embodiments of the present invention 
utilize only some of the features or possible combinations of the features. Variations of 
embodiments of the present invention that are described and embodiments of the present 
invention comprising different combinations of features noted in the described embodiments 

25 will occur to persons of tiie art. The scope of the invention is limited only by the following 
claims. 
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